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(54) Multimedia call signalling system and method 



(57) A system and method for performing call sig- 
nalling for multimedia call setups. A user equipped with 
calling terminals of various types may initiate a call from 
any of these terminals, and the call is intercepted and 
handled by the system. A calling agent looks up an E- 
mail address for the called party, and sends a setup re- 
quest E-mail to a called agent associated with the called 
party The called agent determines the current terminal 



that the callee is using, and together with the calling 
agent a call medium and other parameters are estab- 
lished. Then a connection is made between a calling ter- 
minal and the current terminal. This provides a generic 
signalling system for a callee using a wireline terminal, 
wireless terminal, or H.323 terminal to be connected to 
a called terminal also being any one of these or other 
types. 
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Description 

Field of the Invention 

[0001] The invention relates to a system and method for multimedia call signalling. 
Background of the Invention 

[0002] There are many known call setup methods lor use in setting up calls within the PSTN (public switched tele- 

Lmo nt o?m Sa ua,f,c, and has its own call setup methods tor establishing calls over J ^^^^ 

vTr^us different data networks exist including the Internet, wireline networks, ^^''^'^^^^V^/^^,^'^^"^^^ 
communications systems) networks for example. In addition, calls other than voice call of course are estabhshable 
over such data networks. These include FAX calls, video calls, T 1 20 conference calls etc. ^,^,u,r^, 
r0004] wten a user wants to make a regular phone call, the user's phone informs a switch via a sequence o e^jU^^ 
Smals or a r^essaqe Software ,n the switch will engage a process to find out where the called phone located by 
per'olming an address translation. The address translation will return the information related to which trunk and which 
protocol Should be used to signal a remote CO (captive office) which will ring the called P^one^ 
rooosi in the case of an H.323 terminal, a call setup request is sent in a message to a component called the gale 
keeper tJ plrfo,™ address translation The address passed to the gatekeeper can be a symbolic name or an In ernet 
address in the current H.323 implementation, the gatekeeper will use the H.245 and H.225 protocols to complete the 

[00061 It would be desirable to be able to place calls of various types from a PSTN based terrriinal example for 
connection to a data network based terminal, and call setup methods must be established for this. Existing solutions 
have focused one few particular instances of the problem such as Internet to PSTN voice calls. 
^0007] These existing solutions provide a single solution for one or two media, but do not provide an approach to 

solving tfie problem in a general fashion. , ^ ^- ,ho t„r,oe of rail 

[0008] One of the technical challenges in solving this problem is the complexity and diversity of '^^ tyP^f^^' PfJ' 
30 processing equipment, call transmission media and protocols involved all of which are based on various technologies. 

Summary of the Invention 

[00091 It is an object of the invention to obviate or mitigate one or more of the above identified disadvantages. 

35 0010 According to a broad aspect, the invention provides a multimedia call signalling end system co".pr,s^g a 
calling agent for connection to a network for coordinating the establishment of a connection between a calling terminal 
served by the calling agent and another terminal, the calling agent comprising; a) means for receiving a call setup 
request Uom the calSng terminal including a user identifier; b) means for looking up ar. E^ail ^d-^^^^^^^.J^^^f^^^^^^^ 
with the user identifier; c) means for generating a call setup E-mail w,th said E-ma,l address ^'^^ mail ng it to sa.d 

40 address; and d) first means for coordinating the establishment of an outgoing connection between the calling terminal 

and the another terminal. . , ^ « . ,„l„^^,«„„ 

[00111 A first element empowering this invention is based on an encapsulation principle. Because different telephony 
and communication networks use different signalling protocols, to make the signalling protocol independent the call 
setup requests are encapsulated in a common format. This invention devises a scheme to encapsulate an outgoing 
45 call request with all associated attributes preferably using the MII^E (Iv^ullipurpose Internet Mail Extension) pnnciple 
from Internet Engineering Task Force (IETF). 

[001 2] A second element empowering this invention is the use of an E-mail address or an electronic address for the 
user. Once used, this conceals the discrepancies or deficiencies of the terminals to be connected and broadens the 
choice of tlie medium whicl'i can be used for the connection. 
50 [001 3] A third preferred element empowering this invention is the use of mUE application typing so that an electronic 
message server can associate any required processing with various components in the message. As a result, this 
invention provides a generic mechanism to support multi-media multichannel and multi-device communicalion call 

[0014] The broad application domain of the signalling protocol allows it to be applied to PSTN, Internet and cable 
55 networks and to other network types as it becomes appropriate. It also enables the establishment of multi-media phone 
calls that support multiple terminals and connections. 

[001 S] Advantageously, the system provided by some embodiments of the invention is applicable to existing teleph- 
ony equipment without the need for any change to customer equipment. 
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Brief Description of the Drawings 

[0016] Preferred embodiments o( the invention will now be described with reference to the attached drawings in 



Figure 1 is a logical block diagram of a terminal as it would be viewed by a multimedia call signalling system 
according to an embodiment of the invention; 

Figure 2 is an abstract model of a multimedia call signalling system according to an embodiment of the invention 
Figure 3 is an example call setup walkthrough; 

Figure 4 is an abstract model of the system of Figure 2 including a remote configuration' 

Snr!! ? \ f .^'^'^^'^'^S^^'^s a Calling Agent, calling process. Called Agent and called process- and 

Figures 6 - 12 are signal flow diagrams for further examples of call setup functions and telephony services. 

Detailed Descriptio n of the Preferred Embodiments 

S be accl'Jhi VT^!. '^''"^"^ ^" "'^^ '^"<="°"al blocks that 

might be accessible to a particular user. It is intended to be a somewhat comprehensive view ot all the ways a user 
might be capable of communicating. In reality, a particular user would typically have access only o a subse, of the 

rr^h: user ^ J'^ ^^^'^"^^^ ^^^^^^"^ ^^^'^^^-^^ ^ ---^ is generSy"iicaled 

J^J:J ^ equipment 5 includes various user interface components generally indicated by 10 such as a camera/ 

connected to one or more service applications generally indicated by 22 which include a video service 24. a fax sen/ice 

InZr ' ^"'^ ^ ""'"^ '^^'"^ ^^""^ °' '^-^'^^ applications 22 has access to the user interface 

components 1 0 as required. The voice service 30 is also interfaced with a voice-activated services service application 

SalllndicatTd h?c.R T''" f ^^'^f '^"^.^^ i« '"'^rfaced to the network 7 through a respective medium protocol gen- 
t.rJnho ! ^ ""^^ '"""''^ ^ "''"'^^^ °' types, such as a PSTN (public switched 

IP^confLr ° 1! uVo?'' '"^ "^^^ 38 include video 40, fax 42 T 

ln?prn M^T' ' o ^'^^'^^^^^'^^''^^ "^I^Phony 47, HTTP (hyper-text transport protocol) 48 and IMAP 

by sTandTnc udea'r T '^^ ^ '^"^ ''^^ ^ 9— "V indicated 

a^ aonJcJ^ol H H ^""^ ^ '"^^^ Th"^ transport layer protocol 54 provides 

Networ Lav" transport mechanism. Figure 1 has been simplified to collapse the ISO's Session Layer, 

leslTomnri ■ P""" ^"""^ "-'"^ ^^^^^ '° "^^^"=P°« Layer. While Figure 1 is intended to be more or 

mav ndeed h^r" HHr ' capabilities a user's equipment might possess, it is to be understood that a user 
r^ay indeed have additional equipment for interfacing with the PSTN, cable, the Internet, or some other network and 

0 di erennermrn:!! T °' '''' ^^^'^"^^"^ °' ^'9"- ' -^^^ on a nuUer 
tern^nTo^rS^^ 

TciTsT'^An^.r.lfr °' ■"'^."'^ ' T 'T" '^^'^P^"^"'^ likely be physically connected differently, 

s^hown tn Fiaul J ' "'""""^^'^ "^^^ ^'9"^"'"9 ^V^^^"^ (^^CSS) according to an embodiment of the Invention 

and « Inl Whenever any connection is to be made there will always be a caller having a calling terminal 

1 So an. in I H ' ' ^'^"^^ ^^"^^'^ ""'^^ ^^^'P^^"' f^iS^^^ ' > generally indicated by 
termfni ni tk' °' '""'"'''"^ ' ^'^"''"^ ^O^, a wireless terminal 104, and an H 323 
mSs Ind svJ,^r«r^H"'''''°"' 3"""^^"^ ^- network 7 includes an outgoing 
the MCSS Invo iv?d ZTu ^^^^ end system 82. The outgoing MCSS end system 80 is the portion of 
he MCSS invo ved with handling an outgoing call, and this cooperates with the incoming MCSS end system S2 which 

Ln?:Sms" si 82 Te T^^ '^^ ^''^^P'^ °' '^-e 2. there are two MCSS 

Z JT^ J ^ '^^^ ^y^'^"" '^''"''""9 °^'9°'ng call requests, and the incoming MCSS end 

svs !m ^nT^ '^coming call requests received from the first MCSS end system. A completely equipped MCSS end 

to c^tTrTn ! '° '""'''^ '"'""'''a ^"'^""^'^ '^^"^ ^y^'^"^^ and outgoVTg call requests 

S bo roford to T' ^^'^'"^^^^ ^"'^^ ^'^ MCSS end system while acting upon an outgoing call request 

whiL ac inn nn i ^"'^ Connection, and a connection which is established by such an MCSS end system 

retwo'k ncld.r '"T"' ^"'""'^ connection. In this abstract view this 

rden^ed^unher b^^^^^^ communications links to the caller's terminals. These are 

mroCa reSolS^^ ? of the caller's terminals 102,104,106 are connected the relevant portion of the network 

rSahrdiarriir"^^"^ 

through a dial-up link using Point to Point Protocol (PPP) via a modem, directly connected to the network over 
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ri^L' ',;:f.e=rr To ,.e „„. conn.. ....... 

'A,.n,s, Th„e are .h,ae Ivpes ol Ca.. Salup '^^^^^ " " and an .ncoming call is handled 

called Aflcnls. and Call Agenls. An oulgoing •'•""'^f ^LJ^^T^cT^t lis 117 which ac,s as an inlerlace 

x'A::^^,r;rwnTatar"i'rr^^^^^ 

a called Process 189 to handle each '^coming call 102,104,106 are connected to the Calling 

[0021] The terminal networR -'7'^;;^;^ °f 09 i ?13 and a calling presentation driver 120, 

Agent 1 1 4 through respect.ve 1°^^' '"^^J^^f^^ exchang ng data between the Calling Agent 11 4 and an appro- 

,5 [0022] The presentation d^';;^^;^ ^0 i^^^ with the appropriate terminal). 

priate one of '^V^' ri Irk S^^^^^^^^ be considered a CIP (call intercept point), or a point 

[0023] Each ot the local network '"'f ^^"^ J ,^„„^e„tio flow and convened to signals according to the 

rcTspis: ?h;:=r,ror:,rrTre,„^^ 
- ^AZir s-: is^zr:t:^^:%s^^~^^^ - .n- coma ,„ 

Wireless Networks. h ,«r 1 pn has access to a terminal profile database 1 22 which contains information 

rau;rs ^o^r ,rr.Ti:aC;:rs.:rdrii'dr,: .l-Jo.. », ...... 

1 02, 1 04, 1 06 aenerallv indicated by 1 30 and is basically identical to the caller's 

[0025] The callee's user equipment (5 in Figure 1 ) f "^J^^^ ^^^^^,,3^ through respective terminal network 
:ZZ:"T: r ■n::rnr-rl'"«."ar,==h a .espLi^Acal ne,wp* ihlehace 
rM,'%aaca,,edp,es.n,aliond,i..n.ea„d,n.^^^^^^^^ 

Sshid the'atoneo moreconnections(can 

^fH^^nli c or daTa The presentation drivers will convert data and route it to the appropriate local network interface^ 
For^xample a'oTJ^o PO?S ca^^^ always route through a line card. For video signals from a video-on-demand 
ca me da a will be routed to a co-axial cable. As discussed below, during call setup negotiation, a -^^^dium for use in 
eiab'sh^ng a connection is determined. The medium will require a particular transmission protocol which may difler 
from tS exp^^^^^ or generated by either or both ot the calling terminal and the user's current terminal The cal ng 
pTe^emalion drive" 1 20 must perform a receive type conversion on signals leceived over the connection from the 
i^ Ssion p.:.ocol to the calling terminars native signalling protocol if P'^^^'l^^j;; -f^^rn^i e 

perform a transmit type conversion on signals to be transmitted over the connection from the calling erminals na ive 
signa "ng pTotocol to the transmission protocol if these protocols differ. Similarly, the called presentation driver 146 
musfper^orm a receive type conversion on signals received over the connection from the transmission protocol to the 
•^a 10 J^s urron, torminai's'nativo signalling protocol if those protocols differ, and must perform a 

on signals to be transmitted over the connection from the current terminal's native signalling protocol to the transmission 

55 protocol if these prolocols differ. ^ u * ^ w;H^r«r^t ^oHo^-q 

[0029] The presentation driver may, for example, perform codec conversion to convert between different codecs 
used I two dLren, terminals. For example, one end of the call may be a POTS terminal the codec ^^^^ 'S ^4^^^^^^ 
(64 Kilobit Pulse code fy/lodulation) in order to drive a PSTN line card while the other end may be an H.323 terminal 
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that uses a G.723. 1 codec. In this case the presentation driver has to convert the G.723. 1 codec to the 64KPCM voice 
data forrriRt to deliver any voice attachment associated with the call setup. 

[0030] When graphic data is exchanged, the terminal may not be able to support a certain lormat of graphics and 
so the calling/Called Agent will instruct the respective presentation driver to convert to the appropriate format. A fax 
signal is a form of graphic format. The fax machine is a terminal which may not support a specific type of encoding. 
The presentation driver may have to convert it to an encoding method acceptable go the fax machine. 
[0031] In some case, a JPEG picture may be sent to a fax machine, and in this case the presentation driver may be 
configured to convert the data to a format accepted by the fax machine. 

[0032] Video has many different formats. Most of the time a terminal would have various different software capable 
of handle various video formats. In some situations the terminal will not accept certain video formats. Video conversion 
IS needed when no capable software is available. For example a terminal might only be able to play MPEG 1 (Motion 
Picture Expert Group standard) video in a situation where only MPEG 4 video is sent. Rather than reject the call, if the 
customer has subscribed to the conversion feature, the presentation driver can perform the conversion from MPEG 4 
to MPEG 1. 

[0033] Video conversion is also needed when no compatible hardware is available. For example, when an MPEG 
video IS requested to be send out to a TV via cable, the data signal is not compatible. The presentation driver may be 
configured to convert from the MPEG video to the cable signal. 

[0034] A third video conversion scenario involves rate adaptation. If the link in 28.8 K baud, and the encoded data 
rate for a video stream broadcast is 56 K baud, the presentation driver will convert the signal format suitable for 56 K 
data rate is 28.8 data rate. Sometimes this conversion may require a formal change, e.g. from MPEG to VxTreme. 
[0035] Text may have tobe converted from one encoding scheme to another. For example. ASCII (American Standard 
Code for Information Inter-exchange) text may be converted to ISO Unicode and vice versa. For a terminal, which has 
no display, the text data can be converted to speech. 

[0036] Referring again to Figure 2, each of the Calling Agent 114 and Called Agent 116 are connected to a PSTN 
earner network 1 70 forming part of network 7 through a respective telephony signalling component 1 72.1 74 Similarly, 
they are each connected to a PSN (packet switching network) carrier network 178 forming part of network 7 through 
a respective electronic messaging interface 130,182 (or E-mail server) and through a respective Internet telephony 
signalling components 181,183. The electronic messaging interfaces 180,182 are preferably mail servers and will be 
referred to as such in what follows, and more preferably are MIME E-mail sen/ers. The PSTN carrier network 170 and 
the PSN carrier network 178 may be connected to each other through a bridge 184. The PSN carrier network 178 is 
any traditional Data Network and. for example might be ATM, Internet or Frame Relay. 

[00371 The mail servers 180.182 are used to send E-mail from the Calling Agent 114 to the Called Agent 116 They 
alsoassume the responsibility of delivering reply mail from the Called Agent 11 6 to the Calling Agent 114 These servers 
preferably have the functionality of conventional mail servers in addition to some extra processing functions for realizing 
the MCSS. When the Calling/Called Agent 114.116 starts up, it will register with the respective mail server 180 182 
When one of the mail servers 180, 182 receives an E-mail, it will strip the header and pass the contents to the Callinq 
Agent 116 or Called Agent 114. 

[0038] The mail servers 114.116 preferably take advantage of a conventional mail server's features which include: 

1. Address resolution; 

2. Universal support around different networks; 

3. Store and forward technology that can provide a reasonably safe delivery transport layer; 

4. Message storage server which manages the messages; 

5. Provides notitication service from the network; and 

6. Wide support to access the contents. 

[0039] Preferably the mail servers 1 80, 182 use the MIME (Multipurpose Internet Mail Extension) format and this will 
be assumed in what follows. 1( is to be understood that while MIME encoding is the mosl convenient presently known 
mechanism for formatting the information to be included in the various electronic messages, other encoding and for- 
matting techniques may be used, as appropriate. It is further to be understood that the mail servers 180.182 can be 
replaced by any reliable electronic message transport mechanism which provides the same or similar function For 
example, each mail account could be replaced by a URL (universal resource locator) in which case the electronic 
messages would bo dclrvered to the Called Agent on a web server of the designated URL embedded in a web page 
As another example, a direct TCP/IP connection could be used to transfer the message between the Calling Agent 
and the Called Agent. In this case, the electronic address of the Calling Agent would be a combination of a TCP/IP 
address and a service port number of the TCP/IP connection. 

[0040] The PSTN signalling components 1 72.1 74 handle the PSTN telephony protocols such as ISDN Primary Rate 
ISDN basic rate or Common Channel Signalling Number 7. Other per trunk signalling is also supported by these com- 
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1°1 n rp^^^^^^^ Wireless terminals 102,104 and pass them to the presenta^on dnveM20^ 

eas the Xhony signalling components 172,174 are involved with the actual con ne Con of a call after .t has 

These are usually odu. y ^ ,up u 323 terminal 106 The Gatekeeper in the local network interface 113 
"epTr in .he Inl eme. signalling eo^pcnen.s 18, ., 83 are .n.olv.d wi,h tn, ac.ua connac.ion o. a call af.ar « has baan 

This gateway provides three major functions. 

1 . Signalling conversion - Dunng the call setup phase, the call setup signalling protocol from one type of network 

2 orcTorv'serrces "The directory system for the PSTN and PSN does not have to be the same. If the PSN is 
ATM o X 25 " can L us^ng the E.isl numbering scheme, and there ,s still the requirement to do a conversion 

uanir^ng ''^h^rod^c loTthfwireline ,s 64KPCM, the coded lor Wireless can he a dilleren. type of 
CeT^S (cod" excised linear prediction) and the Internet can be G.721 or G.723. In order to relay the voice signal 
between the PSN and PSTN, the codec has to be changed form one format to another. 

r00431 Each of the Calling Agent 11 4 and the Called Agent 11 6 are also connected to a respective address database 
186 Jis containing a transLion between user identifiers and corresponding E-mail addresses as described in detail 
b!fol WhTe shTwn as two logical entities, the address databases 186,188 may consist of one or more actual data- 
bases. rulermoTe the E-mail addresses may be replaced by any electronic address used by an appropriate message 

mt^TThTSiiTnX^nm 

o) ' a 1 servers 1 8o'l B2. They are activated to process the E-mail messages when '^-^ ^-^^^^ ca" d Agents 
mail sen/er The mechanism which the mail servers use to trigger the activation of the Calling and Cal^d Agents 
m 11 sTs an application class identified in the application class tag forming part of the E-ma.l message body in MIME 

format defined bv this embodinnent of the invention. 

[0045i The CaLg Agent 114 is the entity which handles outgoing calls. The main functions of the Calling Agent 14 



is to: 



1 . perform an E-mail address resolution from the called number or Internet address (fully resolved address or alias) 
requested by the caller; 

2. create a unique reference identification for each outgoing call; 

3. construct an E-mail to be sent to the Called Agent 116; 

4 process the negotiation of call setup parameters; and „ • , o„r4 

s'. participate in the initiation of the establishment of the real call connection after the callee terminal address and 
the call medium is received and settled through the negotiation process. 

r0O461 It Should be noted that through the address resolution using the information from the address database 186, 
the call can be setup on behalf of other devices rather than tor the terminal from which the user initiated the request. 
This type of request would be constructed through an appropriate user interface 1 1 9. For example, a user can use the 
system to set up a call between the cable company and his/her cable reception box for a movie on demand. The Calling 
Agent 1 1 4 will recognize the type of call, movie on demand and engage in a dialog to prompt for more information on 
what movie is requested. The Calling Agent 114 will include the information in a mail message as part of a call data 
parameter using a CALL_DATA option and will send the message to the cable company's Called Agent. When the 
cable company's Called Agent 116 receives the request, it can reply with an acceptance mail and initiate the down^ 
•loading of the movie either through multicast or by injecting the video to the cable co-axial circuit connected to the user. 
[0047] Every customer will have a Calling Agent 11 4 to perform the outgoing call function. The actual implementation 
can be done by a process, a thread or a single process action on data structures which represent the Calling Agent 
114 Because the Calling Agent 114 is not necessarily active 100% of the time, and may be event driven, it is more 
complicated to implement the Calling Agent other than by using the separate process or thread technique. 
[0048] Figure 5a is a stale diagram for the Calling Agent 114. Each user has one Calling Agent 114 to handle the 
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outgoing call. Once it is started, it may create clones of itself to handle multiple calls from one or different terminals 
from the same user. In this example, it is assumed that the Calling Agent 114 spawns a Calling Process 187 to handle 
each call. The state transitions for the Calling Agent 11 4 are defined in the following table: 



State 


Transition Condition 


New State 


Start 


Succeed on initialization and register with the Signalling Components using the 
user's account 


Idle 


Idle 


When a call request is received 


Spawn 


Spawn 


Successfully spawn a calling process to process the call 


Idle 


Spawn 


Failed to spawn a calling process 


Spawn Failed 


Spawn Failed 


Send reject request to the user 


Idle 


Idle 


Received Reply 


Update 


Update 


Relayed the information to the Calling Process 


Idle 



State descriptions: 
[0049] 



State 


Description 


Idle 


Initial state 


Spawn 


Spawn a Calling Process 


Spawn Failed 


Recover after the spawn failed 


Update 


Relay the call related information to the Calling Process 



[0050] The Calling Process 187 is an execution thread or a process to handle the outgoing call Its main design 
objective IS to allow multiple calls to be pertormed simultaneously so as to handle multiple call streams from one or 
multiple terminals. If multiple calls are initialed from the same terminal at the same time, only one Calling Process is 
used because the processing is still sequential. However in the actual detailed implementation, each call from the same 
terminal in a multiple call request can be handled by one of multiple threads or by sub-processes of the Calling Process 
to simplify the processing. Each thread or sub-process is associated with the Calling Process using the call reference 
specified in each call specification in the mail message. The Calling Process does not interface with the mail servers 
directly. Rather, it constructs the MIME message and requests the Calling Agent to initiate the delivery of the message 
Using this design allows the Calling Process to be independent of the message deliver transport mechanism The 
states and transitions of the Calling Process are illustrated in Figure 5b. 
[0051] The state transitions for the Calling Process are defined in the following table: 



Initial State 


Transition Condition 


New State 


Start 


Upon receiving the call request from the Calling Agent 


Address Resolution 


Address Resolution 


Successfully maps the Directory Number or IP address/alias to an E- 
mail address 


Call Init 


Address Resolution 


Failed to map the Directory Number or IP to an E-mail address 


Reject Request 


Call Init 


Successfully construct the MIME message and send the E-mail 


Confirm Pending 


Call Init 


Failed to construct the MIME or failed to send the E-mail 


Reject Request 


Confirm Pending 


Receives a call progress reply 


Call Progress 


Call Progress 


Inlorm the user on call progress 


Confirm Pending 


Confirm Pending 


Receive negotiation reply 


Negotiation 


Negotiation 


Send negotiation reply 


Confirm Pending 
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(continued) 



Initial State 


Transition Condition 


New State 


Negotiation 


Failed to send the reply 


Reject Request 


Confirm Pending 


Receive call accept reply 


Initiate Connect 


Confirm Pending 


Receive disconnect reply 


Reject Request 


Initiate Connect 


Initiate the call connection vy/ith success 


Call Complete 


Call Complete 


Inform the Calling Agent on the completion status 


Start 


Initiate Connect 


Failed to establish the call using PSTN signalling or Internet signalling 


Reject Request 


All States . 


Receive disconnect reply 


Start 


Confirm Pending 


Receive connect abort request from the Calling Agent 


Abort 


Iniliale Connect 


Receive connect abort request from the Calling Agent 


Abort 


Abort 


Send disconnect request to Called Agent 


Start 


Reject 
Request 


Inform user that the call 
request is rejected and clean up 


Start 



r00521 The Called Agent 1 1 6 processes the incoming call request in the mail message. It is actuated by the associated 
man sorveM 82 when an E-mail ,s received. The apphcation class tag in the E-mail is selected so as to be associated 
the called Agent software. In conventional mail systems when the mail server receives an E-mail a -^r ,s not,f ,ed. 
Tn th s case however it is the Called Agent 116 which is informed. The Called ^^--\''^ ^^^^'l'^^^^^^^^^ 
Client software Every customer will have a Called Agent 116 waiting for any incom.ng call. Once the ma 1 server 82 
deceives the incoming mail for the Called Agent 1 1 6, the Called Agent is notified and the E-ma.l ,s passed to the Called 
Aaent which will extract the call information. ,^ ^..^iiw 

5,053] The implementation of the Called Agent 116 should support call parallelism. In a PSTN 
need to setup one call from one to another. But with multi-media, multiple calls may be needed to support ^ud v^dea 
text messaging, fax transfer or file transfer from one user to another users simultaneously. Therefore parallelisnr^ s 
vital to the success of a multi-media telephony system. The implementation of the Called Agent 116 will be parallel to 
the above described implementation of the Calling Agent 114. It spawns a Called Process 189 to process the call 
request. This will simplify the design ol the Called Agent 116. . ^ •, 

100541 The functions of the Called Agent 1 1 6 extracting the call setup request information from received mail mes- 
sages spawning a Called Process 189 to execute the call setup request, and extract the call setup reply information 
and pass this to the Called Process. A state diagram for a Called Agent 11 6 is shown in Figure 5c. The state transitions 
for the Called Agent 116 are defined in the following table. 



State 


Transition Condition 


New State 


Start 


Complete Initialization 


Idle 


Idle 


Call request received 


Spawn 


Spawn 


Created a Called Process successfully 


Idle 


Spawn 


Failed to create a Called Process 


Spawn Fail 


Spawn Fail 


Reported error 


Idle 


Idle 


Received Reply 


Update 


Update 


Inform Called Process 


Idle 



[0055] A Called Process 189 is an execution thread or a process which will serve the call setup. It does not interface 

with the mail server. Rather il gets information (rom the Called Agent. Therefore, the Called Process can work with 

other mechanisms which deliver the call setup request and call reply messages in MIME format. 

[0056] The Called Process uses the User Profile Database 1 8S to find the current terminal which the callee is working 

on. If the current terminal can terminate the call, the Called Process can construct a reply mail message to accept the 

call. 
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[0057] It can also use information in the User Profile to perform call filtering, for example, to reject calls from a 
particular user or to only accept calls from a list of explicitly specified people. 

[0058] A state diagram for a Called Process is sfiown In Figure 5d. The state transitions for a Called Process are 
defined in the following table: 



State 


Transition Condition 


New State 


Start 


Received the call setup request 


Activated 


Activated 


User profile requires call hand over to Call Management 


Call Management 


rAt^ li V a toU 


User profile requires call hand over to Personal Agent 


Personal Agent 


v-'dK ividf idyemeni 


Call is accepted but requires negotiation 


Accept 


odii (vicjnayemeni 


All information is received, 

Call can be presented to the user. 


Present 


Call Management 


Call is rejected. 


Reject 


\^ci\i ividF lay fcjf 1 Icjr 11 


Call is completed and no more call setup is needed 


Complete 




Call is accepted 


Accept 


rersonai Agent 


All information is received. 

Call can be presented to the user 


Present 


Personal Agent 


Call is rejected. 




Personal Agent 


Call is completed and no more call setup needed 




Activated 


Call is accepted 


MCCepi 


Activated 


All information is received. 

Call can be presented to the user 


n reseni 


Activated 


Call is rejected 


Reject 


Activated 


Call is complete and no more call setup is needed 


Complete 


Accept 


Require parameter negotiation 


Negotiate 


Negotiate 


Receive a negotiate reply 


Negotiate 


Negotiate 


Parameter match 


Present 


Present 


Successfully offered to the terminal 


Alert 


Present 


Failed to offer the call 


Reject 


Alert 


Send Alert call progress reply to Calling Agent 


Complete 


Alert 


Connection timed out and call forward option is available 


Forward 


Forward 


Send Forward call progress reply and forward the mail message 


Exit 


Reject 


Send Reject call progress reply to Calling Agent 


Exit 


Disconnect 


Send clean up message 


Exit 


Complete 


Send Disconnect reply to Calling Agent 


Exit 


All Stales 


Upon receiving a Disconnect from the Caller 


Exit 


All States 


Upon received an abort request 


Abort 


Abort 

1 


Send Disconnect to Caller 


Exit 



the Called Process state transition diagram of Figure 5d are described in the following table: 



State 


Description 


Start 


Initial state of the process 
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(continued) 



State 


UeSCripiion 


Active 




Call Management 


\A/K«r. iKo nail \c h^nrir^d off to the Call Manaqement System, the Called Process remains in 

Wnen ine Call is lldlUJcU UM iw mc; wail ivit-*i 1 iv^' 7 

this stale until the call is returned from the Call Management System 


Personal Agent 


xA.u. ^oii honHoH nff to thP Pprsonal Aaent Svstem. the Called Process remains in this 
When the call is nanoeu on lo ine r t»ur \cx\ rvyci u oyoici 1 1, u 

stale until the call is returned from the Personal Agent System 




The call can be processed to either be presented to the caller or for negotiation 




The call enters the parameter negotiation process 




The call is presented to the caller's terminal 


Alert 


The terminal is ringing and the Called Process has inlormed the Called Agent that the caller s 
terminal is ringing 


Forward 


The call is forwarded to another Called Agent 


Reject 


The call is rejected due to various reasons 


Disconnect 


The call will not be connected. The Catling Agent wilt be instructed to disconnect the call 


Complete 


The call has been established 


Abort 


The call has to be abruptly terminated 



rooeoi in the description which lollows, the distinction between the Calling Agent and the Calling Processes which 
it spawns is largely ignored for the sake of simplicity, and a similar simplification is made for the Called Agent and the 

Called Processes 

rooen The Call Agents 115,117 are the entities which handles interactions and interfaces with the address database, 
terminal profile and user profile. They also handles the management of the Calling Agent and the Called Agerit. User 
or Telephony OA&M systems interact with the Call Agent to maintain the profiles. The following are the functions of 
the Call Agent: 

1. interface with the Telephony company's Operation, Administration, fvlaintenance and Provisioning system 
(OAM&P) lo configure and maintain the user profile and terminal profile; ^ „ ^ 

2. Collect calling detail records (CDR), operation measurements (OM) and logs from the Calling Agent and Called 
Agent; 

3. Provide the CDR. OM and logs to the Telephone company's OA&M system; 

4. Accept change of terminal request from the user and update the user profile; 

5 Responsible for the startup and restart of the user's Calling Agent and Called Agent; and 

6 Access the mail account for the user to retrieve call information. If the user would like to review how many call 
have been received today, the number of call setup request E-mails can be retrieved and presented to the user. 
These E-mail records are like caller ID records on a Caller ID Display device. 



ADDRESS DATABASE 

[0062] A major principle used by this invention is address translation which may be implemented as a form of directory 
look-up This invention introduces new procedures into the address translation process used by the CO and the Gate- 
keeper and rather than using the native signalling protocol to complete the phone call, an additional layer of signalling 
protocol is introduced to allow the far end to handle the call indifferently for a wireline, wireless, and Internet phone. 
This new protocol does not replace the conventional telephony protocol but adds an additional layer to provide proper 
coupling between different telephone networks. More particularly, call setup signalling is performed through E-mail 
communication between the Calling Agent 114 and the Called Agent 116, Once the type and medium forthe call have 
been established, the conventional telephony signalling components 1 72.1 74 and/or in the Internet signalling compo- 
nents 181 ,1 83 are used to complete the connection. 

[0063] For a given user, there will be one or more user identifiers. Each user has a one or more separate user 
identifiers for each type of network identifier for which the user has terminals. For example, if the user has a wireline 
terminal and a wireless terminal, both of these terminals will have an E.164 type network identifier, and can together 
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be represented by a single user identifier winich also in E. 1 64 fornnat. If the user has an H.323 terminal then the user 
would have a user Identifier which is an H.323 Internet address. The purpose of the user identifier is to provide keys 
into the address database 1 86 which contains a mapping from user identifiers to MCSS Called Agent E-mail addresses 
For each user of the MCSS provided by this embodiment of the invention, there will be a single unique designated 
Called Agent having a unique E-mail address. Thus, for a user having a E.I 64 user identifier and an H 323 Internet 
address user identifier, the address database 186 will contain a translation from the E,164 user identifier to the Called 
Agent E-mail address, and a translation from the H.323 Internet address user identifier to the Called Apenl E-mail 
address. It is not necessary that the user identifiers correspond with actual addresses of the user's terminals The 
requirement for a different user identifier for each network type stems from the fact that a call setup request from an 
H.323 terminal must include an H.323 address, and similarly, a call setup from an E.164 based terminal must include 
an E.164 terminal address. 

[0064] In addition to this translation information, for each user identifier there will be an identification of the types of 
call media supported by the associated terminals. It may also include a quality of sen/ice capability of the terminals If 
a call setup request is received demanding a quality beyond the capability of the destination terminals, this can be 
Identified. There may also be a pointer to a system or application which is to process the call setup request for the 
particular terminals. When a call is to be connected through to one of the terminals, the application is activated 
[0065] This address database may be implemented using LDAP (lightweighi directory access protocol) or X 500 
directory services lor example, depending upon the design of the network. 

TERMINAL PROFILE 

[0066] The terminal profile database 1 22 contains a terminal profile for each terminal owned by a user and which 
has been registered with the MCSS. When a terminal is being used which is not one of a user's registered terminals 
there will be no terminal profile for that terminal. In this case, a canned terminal profile can be generated dynamically 
based on any information available. Each terminal profile has a reference which can be a string or a number but which 
IS preferably selectable by the user. Preferably, aliases may be used which allow users to identify their terminals usinq 
names they have personally selected. 

[0067] The terminal profile for a given terminal includes the following information: 

Network identifier - the terminal idenlifier of the terminal within its native network. For an H 323 using a dial-up 
service, the terminal idenlifier is an IP address which is updated by the Gatekeeper after the customer has regis- 
tered (I.e. signed on); 

Terminal Type - Terminal type describes the type of terminal. It can be a wireline, wireless or H 323 terminal lor 
example; 

Terminal Capability - This is a list of capabilities which the terminal can perform; 

Subscribed Services - This is a list of subscribed services associated with this terminal. This permits a user to 
subscribe to different services on different terminals, and thus todifferentiate the cost of ownership of each terminal. 

USER PROFILE 

[0068] The user profile database 124 contains a user profile for each user The user profile contains the vital data 
ol the user including the user's current terminal. More specifically it preferably includes the following for each user: 

Legal and Billing Information - This contains the name, and the address for the user's account; 
Mail Account - This is the name of the mail account associated with the user This account is used to send and 
receive E-mail for call setup or call termination, and is not visible to the user This account has a unique name 
designed by the provider of the MCSS; 

User Account - This is an idenlifier of the user's account which the user uses to identify himself/herself to the 
system as a form of authentication when using the MCSS from a terminal which is not a registered terminal It is 
keypad"'^ ^" alphanumeric and non-case sensitive string so that the name can be entered using a telephone 

User Password - This is used together with the User Account to access the Gystem to change the user profile or 
setup a call from a terminal. The password is preferably alphanumeric such that it can be entered through a tele- 
phone keypad. For advanced systems, the password may be entered through speech recognition technology- 
Private key - This key is needed for non-secured access such as Internet access to permit deciphering a password 
from a terminal which has encryption capability The terminal will encrypt the password using a public key The 
private key is not available to the user for security reasons. The private key is assigned by the signalling system 
provider; ^ ^ ' 
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subscribed Services - This describes ncn-termir.a, related services ^^^^c^j;^^^^^^^^^^^^ 

contains information on what services are subscribed to on every terminal using the MCSS. Examples are a per 
sonaTager!"Trvice which permits call filtering or screening, and unified messaging wh,ch provides access to a 

CuireTlerminal - This points to the current terminal associated with the user. The current terminal is only allowed 
^o be oneThe predefined set of terminals for which terminal profiles exist or can be created dynamica ly, 
current Ca Management - This points to a current call management description. Call management features are 
d 'ed by hrexfsTng'e ephone company such as a list of terminal numbers which can be -^t-vated by name 
dlaTng culmlzed announcements lor specific calling IDs, offering calling information to the user with the option 

to reiect the call answer with a recorded message, or return a busy signal, 

SualiW of Se v^^^^^^^^^ determines the grade of service subscribed to by the user. The user can request automatic 
?S?to v2e Ove! IP gateway for long distance using a specific codec, for example. Some codecs require less 
Lndw dth whl? can be more Internet delay. The quality of service may also be used to determine 

how a ermri call is to be routed. For example, when a call is originated from the PSTN for connection to H.323, 
mTop fonTan be'lLed ^ determine whether a near end gateway or a far end gateway is used^ Near end ga^way 
wiN bT Cheaper but subject to Internet delay. For end gateway will be higher quality but may result in the requirement 
Of paying distance charges, 

[0069] Alternatively, a call may be setup over an ATM networK in a private data network rather than over the global 

Inlernet; 

Personal agent sen/ice ■ This points to any implementation of a personal agent to which the user has subscribed 
or has aicess When a call setup request is received, the request can involve the personal agent implementation 
to Derform advanced functions such as filtering; • . 

cTForarAddross - This stores a call forward address. This may be a terminal address of a terminal not 
belLg°n"tthe us" to which the presentation driver may deliver a call, or a n ew E-mail address of another Called 
Agent. 

CALL SETUP REQUEST 

r00701 The first step in setting up any call is a call origination from a calling terminal. This will result in a call setup 
request in ^he proSol ol the native network of the particular calling terminal. This may be a conventional call setup 
rSues Which is the same whether or not the MCSS provided by this embodiment of the invention is -sed. The caH 
setup request is intercepted at the call intercept point, this being the local network interface for the particular ca ing 
L^m^al ^he etup request is then passed through the relevant local network interface and the calling presentation 
dr ve 1 0 t"^^^^^^^ Agent 114, The setup request includes a called user identifier for the called party A^ernat.e y^ 
the call setup request may be generated trough the user interface 19 which permits a more generalized call setup 

[oSrif ' AS de^Icnbed below, the called user identifier is translated by the Called Agent 11 6 to a terminal identifier lor 
whichever of the user's terminals is the active or presently selected. 

E-mail MESSAGE STRUCTURE AND CONTENTS 

roo721 call setup and call reply E-mail messages are used to perform call setup signalling according to this embod- 
Imeni Ol the invention. A call setup message is generated once by the Calling Agent to activate call setup activities^ 
Thereafter call reply messages are used for the remaining liletime of the call setup and may be generated by both the 
calling Agent and the Called Agent. Each component ol a message is referred to as a parameter, and a parameter 
may itsell contain parameters In the following, the contents ol the messages are described hierarchically. Messaging 
is prefe.ably done using the RFC 1341, 1342, 1522 and 1531 MIME (Multipurpose Intemet Mail Extensions) format. 
The following message formats are defined using BNF's (Backus Naur Forms) but this may not necessanly be the case. 

MIME Signalling Message BNF 

[0073] This is the generic form of any message being usod lor the MCSS, and applies lor both call setup and call 

reply messages: 

<mime-signalling>::=<call-seiup>l<call-reply> 
In the above, the symbol "I" means that one ol the two components it separates is included in the message, i.e. either 
the <call-setup> component or (he <call-reply> component. 
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CALL SETUP E-mail MESSAGE 



[0074] In response to a call setup request, the Calling Agent 11 4 constructs a call setup E-mail message addressed 
to the E-mail address associated with the called user identifier This involves filling in the <call-setup> fieid of the above 
described generic call signalling E-mail message as follows: 



<call-setup> : :-<rnime-header><calli.nfo><call info^-.'rnime-datav- 
ro <mime-header> : : ^ "MIME-Version : 1 . 0 " CRLF 

<callinf o> : ; =<ca 1 1 info-header ><cal 1 in fo - body >< op ti ions > ^ 

<a t. tachmen t > ^<cal linf o-end> 
<callinfo-header> : : = "appl ica 1 1 on /x -cal 1 " ; <houndary- 
speci f ica t ion> 

<callinfo-body> : :=<cal T >CPL,F<ca 1 led>CRLF <ca 1 1 -medium^CRLF 

<call-ref >CRLF<call-action>CRLF<quality> 
<caller> : : ="CALLER- SP^^ ( ^^<address> [ - , "<name>] " ) " 
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tCp> 
<udp> 
<r Lp> 
<ur 1> 



<called> : : ^"CALLElE" SP'^ ("<address> [ " , "<name>l " ) " 

<rnedium> : : ^'MEDIUM" SP ( "VOICE" | ^"DATA" | "VIDEO" | "FAK" ) 

^:ref erence> : : ^"REFERENCE" SP<re£erence value> 

^■quciixLy>: :-^^QUALITY" SP<gua 1 i Cy - 1 i s L > 

<options>: :^^^OPTIOM" S P ( Opt lon - 1 i s t ) 

<ar,t:achments> : : -<mime data> 

<ca] linf o - end> : : = - - " <boundary r.ag> 

<address>: : =<e . 164> | <ip><ccp> 1 <udp> | <rtp> | <url> | . . . 
<e . 164> : : =M " "E164 " , "<ITU E.164 phone number 

speci f icacion> " ] " 
<ip>::="("IP ,"<lnterner ip address ">" 

:zz^-TCP"^\ "<Int:ernet IP addr ess> " : " <number > 
; "UDP" " , "<r Internet IP address > " : " <number> 
; =^ ^'RT?" " , "<lnternet IP address> " : " <nuniber > 
:-^^URL"". "<URL address> 
<medium> : —"VOICE" | "DATA" | "VIDEO" | "TKA" 

<.ciuality-lisc> : ( - <quali ty-valuexqual i ty- value> * " ) " 
■-quail ty-value> : : -<g r ade> | <delay> | <ccdec-list> 
<grade> : : = " ( "GP^DE" ^^ " ( - TOLLQUALITY " | "NEARTOLL" | 

"ACCEPTABLE" ) " ) " 
<dolay> : : ^" ( ""DELAY" " . " <mil 1 iseconds> " ) " 
<r:odoc-l i st> : : ( "CODEC" , "<roder> ( " , "<codec.>) ) " 
.::coder>: :="H.723 .1 " i "H.729" | "64KPCM" | "32KPCM" | . . . 
<option-lisc> : : = " ( <opr ion- value> , " <option-value> ) ) " 

< o p t. i. on- va 1. u e > : : = 

"CHARGEBACK" | "CALLBACK" | " RING3ACK_WHEIS]_N0T._BUSY " | . . - 
<call__daT:a_list:> : =<call_data„value ( SP<call_data._value> |NULL) 
<call_daca_value> : - " ( '*<key>" , " <cal l_data„value> " ) " 
<key>:- any data encoded in a data format acceptable by the 

<value>:= any value encoded in a format acceptable by the MIME 
spec i L icacion 

SP : : = ( <space> ] < ve r t real tab> ] <.horizontal tab> 1 <1 ine f eed> | 
CRLF : = ( <carri age returnxline f eed> ) (<carr-i age returnxline 
f eed>) 

<3pace>: :^spaco character 



14 



EP 0 924 918 A2 



<vertical tab>::= vertical tab character 
<horizontal tab> : : =hori2ontal tab character 
<line feed>::=line feed character 
<carriage return> : : =carriage return character 
<name> : : =any MIME acceptable string or data 

CALL REPLY E-mail MESSAGE 

[0075] In response to a call setup message, the Called Agent 116 constructs a call reply E-mail message addressed 
to the E-mail address associated with the Calling Agent 11 4. In addition, any further communication for the file of the 
rnnlc^ "^""^ ^'^"^"^^ '^^'^ "^^ssages from the Calling Agent 114 to the Called Agent 116 or vice versa 
[0076] The reply E-mail content is also encoded in MII\^E. This involves filling in the <call-reply> field of the above 
described generic call signalling E-mail message as follows: 

<call-reply: : =<mime-header><reply-body> 

<reply-body>: : =<reply- tag> " , " <boundary-Gpec i f ica t ion>CRLF 

<reply><boundary- tag> 
<reply-tag> : : ="Content- type : application/x-cal 1-reply " 
<reply> : =<progress- indicator> | <connection> | <negotiation> 
<progress-indicator>: : = : CALL_OFFER_STATUS " SP<non-accept- 

cail-state> 

<connection> : : = "CALL_OFFER_STATUS " SP" ACCEPT"CRLF 
<ref erence>CRLF<progress>CRLF 
( <medium>CRLF) 

(<caller>CRLF<callee>CRLF) 
(<quality>CRLF) * ( <option>CRLF ) * 
(<attachinent>CRLF) * 
<non-accept-call-state> : —"RINGING" | "FORWARDED" | "COMPLETE" 
" ( " "DISCONNECTED" , <reason> " ) " | 
■ " ( " "REJECTED" , <reason>" ) " 
<negoLiation> : : - "NEGOTIATION"CRLF<callinf o> 

\ni^r " "^^^ mechanism to provide call progress. It is also used as a call accepting notification 

If the Calhng Agent wants to terminate the call before the actual call setup is completed, it can also use the reply 
message to instruct the Called Agent to terminate the call using the <non-accept-call-slate> of "DISCOI^NECTED" 
With a reason in the <reason> field. 

^^J!] °' 'he reason field can be implementation dependoni. I. may for example be digiti70d 

H~ M^r" u " '° ^ '° ^^"^^ 'he call is rejected 

However, IVIIf^E allows any data type to be encoded to improve the information density of the communication 
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Explanation ol the Fields ot Call Setup E-mail Messages 
handle new parameters and keywords. 

[0080rV"r,rrequired by the M,ME specification to indicate the beginning of the contents of the message; 
aeline Ihe suing "eor as a bomdary. The boundary would Ihen appear as --eol 

,b7invS is graced a desi9r«,«on lor ,b,s Cass o, app.ca.lor,, .be -x-ca.- c=u« men bo obar,9ed ,o so,.e,b,r,9 
" fSiir Tbe SLllon IS grouped b, a bound,^ us.ng a bounda, specl„c,lo„ a. discues.d ab^.. Tbo ln,or,.a,ior, 

associ^erwShTe ca ing party to a second series of one or more terminals associated with the -1-ed party For 
J^am^ a Waller with an ISDN terminal may request two different outgoing connections to a s,ngled or mult pie ca led 
"rmTn'il Such a r^ultiple call racues, may be generated through the user interface 1 99, or directly from the call.ng 
terminals if the networl< interfaces are modified to receive such requests. 

roOSSr^h^r is the component containing the caller information. The information is either an ITU E^164 address (esn 
nurnber) oran Intemet address which can be in dot numeric form (e.g. 47.34.5.1 21 ) or symbolic form (e.g.ck.pcn.nortel. 
com Tir'ar^ieToX of the caller ,s a feature which supports the Caller ID function. In PSTN networks, this name 
can be extracted from directories. In the IP world, this would be a name of the originators choice. 

[0086r™s^s the component for callee information. The information ,s either an ITU E.164 address (-n -mber) 
oran ntemet address which can be in dot numeric form (e.g. 47.34.5.1 21 ) or symbolic '^^'^ (^:9-^^'^-P^""°^f 
The address in the <called> field may also be specified by name. This is the equivalent of symbolic dialling. The function 
I, the calS directory number in this signalling protocol is only to permit E-mail address resolution for the called party. 

■40 preferences 

r0087] In order to identity every call setup request, a unique reference identifier is given to the call setup request. 
When the Called Agent replies, the reference is used to associate the reply with the request. 

r0088r''Th'isTag is used to specily the preferred call medium information. The medium of the call tfiat can be estab- 
-,5 ished depends on the support o, the underlying network(s). The basic types are voice call (like the telephone servi es 
Offered by Bell) data call (e.g. TCP/IP call for data communication) video call (video image communication) or fax (for 
facsimile transmission). The call medium is qualified using a keyword. A few keywords are listed here and include 
VOICE, DATA. VIDEO and FAX. More keywords may be added for additional call media. 

so ro089r Ouamy is the parameter to express what will be the quality of service. It can be as simple as strings of tokens 
Which are bilaterally agreed upon or key-value pairs in strings, e.g. (FRAME_PER_SECOND,10) or a range of values 
(MODEM_SPEED 300 2400,0600.28800). This parameter is especially important to the H.323 terminals. There is op- 
.tion negotiation built into the H.323 protocol family but it is an optional feature. The negotiation cannot always take 
place Therefore this parameter provides another alternative to perform the negotiation. If negotiation is required, the 

S.5 negotiation is done by sending a call request E-mail, such as described in this section, and the reply E-mail such as 
described in the next section back and forth using the same <reterence> until both sides are satisfied, 

[OOeor'The option parameter is used to specify call options. Some of the options can be REVERSE_CHARGE. or 
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EXECUTIVE_BARGE_IN. JOIN, or other telephony features. 
<call_data_list> 

[0091] This parameter provides any <call-data-value> arguments associated with the call setup When the Called 
t'ZZT"" °' ''''' "^'"^"'^ '''' ^^•"P "^^ - -^-^^ The' orw'g are some 

termina;'""""""""'' '''' " P'"'^" ^ '^^l' ^° Played on the ;emote 

thi vfe'^grmTetc" '^^ -9-9^ °' '^^ ""e, 

<attachment> 

[0092] Attachment is any MIME compliant contents. It can be fax, video, audio or text as defined in RFC 1521 Ths 
purpose Of the auachmant component is to enrich the contents of the call request E-mail so thras Ich^nformauSn 
ZZrT ^ °^'9°'"9 caller information can be added 

athPr ,h« ^ "^T'" °' " " '^^^ P'^y^^ °" ^ ^-323 '^^-inal as a ca° announcement 

athP hf r^rt ' " " ^ " "'^P'"^''*^ °" graphic enabled terminals, e.g. PC or NC based H 3^3 

ather ,han the default call alert user Interlace. To a great extent, because the attachment will be stored a, The E maii 
server assocated with the Called Agent, the user can retrieve the information by any Unified l^essaging Sylm suc^ 
^nnlT ^^^ °' "^''"^P" Communicator from Netscape Communications 

Tt^l atiZl^LTZ^TTT T "^'^P ""^^"9^ "^'^^'^ '^'^'y "° '''^i'^'^^" °" type 

<addreTs> ^"^^'^'^^"'^ "^^y necessarily be processed by all implementations of the Called Agent. 

[0094] The address can be the type presented but can also be extended. It can be any E 164 address Internet 
protocol address, Inlcmot protocol service address etc ^J' y <=, i aaarcoo, internet 

Explanation of the Fields of Reply E-mail Messages 

[0095] Many of the fields in the reply message are the same as in the setup message and as such th^sP will not 
be redefined here. The following fields are specific to the reply message 
<reply tag> 

for°fh'i seiu'p mi'sSrilThriAMTn':' 'r "apPlication/x-call-repiy, As in the class specification 

.IphonySll'epfy ' ' '''' '^'^P'^^"^' '^'^ ^"'^ ^« ^=^^-9^^ 'o content-type: 

<progress-indicator> 

ca^^^ibo^uhlllTpToS"^^^ °" ''^ ''^"^"^^ °' '^^ '^'^-^^^"^ " ^^'^^ '° 

<connectton> 

[0098] This parameter indicates the acceptance of the call, and is a request to setup the call 
<non-accept-call-state> a ■, 

Aaent RETECT tf 1 the callees terminal ,s ringing, FORWARDED if the call is forwarded to another Called 

naS onhifcall' setup re^u^r''' " DISCONNECT if the Called or Calling Agent request the termi- 

<negotiation> 

S hp'^h« "hh""'"^', '".'""^^ '^'"'"9 ""sent or the Called Agent to change some of the setup parameters values 

oJiTl The 1^1 1 T °' ' ''''''' °^ '^^ °' '^^ example, 

[0101] The following table contains an example ol the contents of a call setup E-mail message 



Line 


Description 


MIME-Version; 1.0 


MIME header 


Content-type: application/ x-call; boundary=0ot 


application class 


CALLER(E164M6137638533, 'CK Wonq") 


Caller PSTN user identifier for CK Wonq 


CALLEE (El 64.61 32322486) 


Callee PSTN terminal number 


MEDIUM VOICE 


request setup a voice call 



10 



15 



20 



25 
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(continued) 


Line 


Description 


REFERENCE 0034332044 


call reference is the string "0034332344** 


QUALITY ((GRADE. TOLLGRADE). (DELAY.O)) 


sound quality is toll grade with no delay, e.g. 64KPCM 


OPTION ("RINGBACK_WHEN_NOT_BUSY") 


a treatment is requested to inform the caller if the callee is busy 


Gonlenl-lype: text; boundary=eom 


Thic f-aii h««^ 'rin attachment which can be used as call ID 

iniS Call lido alt cii iciv^i nii^iii. 

information. The message may be displayed on an ADSI 
terminal for the ourpose of visual call waiting, the information 
can be displayed as part of a call alert on an H.323 terminal, or 
the information can be used as an announcement of arnval for 
a conference call 


This is a call from C.K.Wong 


The message 


--eom 


End of attachment boundary 


--eol 


End of the message boundary 



so 



55 



r01 021 The above example E-mail message is from a caller having telephone number 61 3673B533 to a bailee having 
^PS™ usl?«:r1?32322486 (which may or may not also be the ^^^^^^'i;^^^^^^^ O^Ts pu^ty 

as the preterred medium, 0034332344 as the setup request reference, grade - tollgrade f ^ .^^'f^ " 
specficSns, the single option RlNGBACK_WHEN_NOT_BUSY, and a text attachment conta.n.ng the text Th.s ,s a 

call trom C.K.Wong". 

[01 03] The following is an example ot a call reply message; 





Line 


Description 


30 


MIME-Version: 1.0 


MIME header 


Content-type: application/ x-call-reply; boundary-eot 


application class 




CALL OFFER_STATUS ACCEPT 


The call is accepted 


35 


REFERENCE 0034332344 


To inform the Calling Agent that this call is for the call which 
has the reference "0034332344" 




MEDlUf\/1 VOICE 


The Called Agent agreed to setup a voice call 




CALLER (E164. 61 37638533) 


The caller's directory number is not changed 


40 


CALLEE (IP.47. 34.5. 121) 


The callee will connect the terminal on an H.323 terrriinal. 
Its IP address is "47.34.5.121". 




QUALITY ((CODEC. G.729, G.711), (DELAY,15)) 


The codec can be G.729 or G.71 1 . The terminal can handle 
a maximum network delay of 1 5 milliseconds for any voice 
packet 


45 


--eot 


End of the message boundary 




OUTGOING CALL INTERCEPTION 



[0104] Outgoing Calls are intercepted in various manners depending upon the nature of the outgoing call. 
Outgoing Call Interception; Wireline Terminal Call 

[0105] When a wireline terminal 102 makes an outgoing call, the call is initially handled by the CO of the telco this 
being the local network interlace 109 lor a wireless terminal. The CO will do an address translation to find out how to 
deliver the call For the MCSS. the address translation will result in the call be.ng directed to the Calling Agent. The 
call request is forwarded from the relevant local network interface 1 09 to the Calling Agent 1 1 4 via a message through 
a communications link between the local network interlace and the presentation driver 120 such as TCP/IP channel 



18 



EP 0 924 918 A2 



established on demand or earlier. 

[0106] The caller's information is collected either from the dialling tone or pulse, or from an IDSN call setup message. 
If this is a normal fax call, it cannot be identified as such until later. However, if the call is done by a two stage dialling 
procedure, which includes a first number for the fax delivery and a second number for the final destination, the type of 
the call can be identified by the time Calling Agent is informed. 

[01 07] In some cases, the call setup can be forwarded to the Calling Agent via a remote SCP query It is not necessary 
to always be done from the local CO. The address translation can be handled via an SCP (signal control point) database 
Most of the time now, it is handled by the SCP query. The SCP can reply with where the call is to be routed and with 
what treatment. This is illustrated in Figure 4. In this example, a user makes an outgoing call from a terminal 300 vyhich 
is initially handled by a CO 302. 

[01 08] The local Captive Office sends a query to an SCP 304 to find out where is the called address. The result from 
the query Indicates that the called address is at another Captive Office. The call setup request is routed to a System 
Signalling #7 (SS7) network 306. The SS7 network delivers the call setup request to a Local Network Interface 308 
the remote switch. The request is received by the Local Network Interface 308 of the remote switch and passed on 
the presentation driver 120. The presentation driver 120 extracts the information in the CCS7 call setup message and 
passes the call setup request to the Calling Agent 114. 

Outgoing call Interception: Wireless Terminal Call 

[0109] A Ceico uses a similar mechanism to the mechanism used by the above-described leico to inlercepl an out- 
going call from a wireless terminal 104. The call setup request is sent to the Calling Agent. 

Outgoing Call Interception for an Internet Call 

[0110] When an H.323 terminal 106 makes an outgoing call, the outgoing call is intercepted by Ihc local network 
interface 113 which in this case is a Gatekeeper. 

[0111] Preferably, the Calling Agent will be the Gatekeeper for all the outgoing calls. This minimizes overhead and 
duplication. Alternatively a separate Gatekeeper may be used. One attnbute required for an H.323 terminal is its IP 
address. If the Calling Agent does not handle the Registration and Administration Service for the dial-up line, the 
Gatekeeper performing Registration and Administration Services has to update the Calling Agent on the IP address 
[0112] The callee information is in an H.245 call setup request. The information can be extracted and forwarded to 
the Calling Agent. 

[0113] In a specific implementation, the Calling Agent can be extended to support the H.323 call setup. 
CALLED AGENT MESSAGE PROCESSING 

[0114] The Called Agent, upon receipt of a call setup E-mail message together with the Calling Agent is responsible 
for coordinating the setting up of a connection between the calling terminal and one of the callee's terminals. In some 
cases, the Called Agent may respond with a call reply message. After the appropriate medium has been identified 
through negotiation if necessary, the relevant native signalling components are used to setup the connection these 
including the telephony, signalling components 1 81 . 1 83 and the Internet signalling components. 

How to Connect a Call from a PSTN Terminal to PSTN Terminal 

[0115] For the purpose of this example, it is assumed that a connection from a wireline terminal 102 to a wireline 
terminal 1 32 is to be made. 

[0116] Once the E-mail is received by the mail agent of the called party, the Called Agent (which is an application 
associated with the mail server) will process the E-mail. The association of the Called Agent program is done by the 
application tag in the MIME. The Called Agent will extract the called terminal identifier. There are two treatments that 
can be applied: 

1. The Called Agent will interact with the telephony signalling components 1 72.174 to establish a voice channel 
from the captive office associated with the mail server to the captive office where the caller's call was intercepted 
The channel is established using the caller's phone number in the E-mail. This ensures a voice channel is available 
Then the Called Agent will use the local CO facility (in the local network interface 109 for the wireline terminal 102) 
to present the call to the callee based on the information associated with the callee's current location record main- 
tained in the User Profile database. When the callee picks up the phone, the voice channel between the caller and 
callee is bndged. The setup process finishes after a reply message with CALL_OFFER_STATUS COMPLETE is 
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2 The Sled Agent will inform the Calling Agen, regarding ,he current location of the callee ,n a reply ma. I The 
<reference> in L E-mail is used to relate the reply to the call. Then the Calling Agent can establish a call to the 
cie s curr^^^^^ location using the existing conventional telephone protocol with ^^^^'f P^^^^^^^^ 
ponents 172,174. Either parly can finish the call setup by sending a reply message with CALL_OFFER_STArub 
COMPLETE to the other party. 

How to connect a call from an H 323 terminal to a PSTN terminal 

r0117] When the calling terminal is a PSTN terminal and the called terminal is an H.323 terrrjinal, the call cannot go 
h ouQh directly When the user's H.323 terminal 106 originates an outgoing call, it sends the request to the local 
network fn erT ce Vl 3 which is the H.323 Gatekeeper The Gatekeeper has the responsibility o. performing the address 
lookup (because the address can be symbolic or alias names) which requires the address to be resolved into number 
dot nolaton (e.g.bmerib71. noriel.com is translated to 47.34.5121). This function Is similar to the address translation 
in the PSTN Captive Otfice, 

1 The dot notation address ot the callee is used as a key to query the callee's infornnation in the address database 
IsrThis dalabase maintains the mapping between the Internet address to the E-mail address of the caliee's 

?The calfeTand callee address information, cal! medium, and other parameters are used to construct the E-mail 

^ ThrE^^'mat^^ lenUo the caliee's Called Agent. The Called Agent will respond with an E-mail including the 
callee-s terminal identifier which will be an PSTN E.164 address. The Calling Agent makes a decision of whether 
the call is to be connected through the PSTN 1 70 or the PSN 1 78 or both based on billing and quality considerations. 
Once it is established that the catling terminal is an H.323 tormina! and the called terminal is a PSTN terminal, 
there are existing procedures for using the PSTN telephony signalling components 172.174. the internet signalling 
components 181 ,183. the PSTN 170. bridge 184 and PSN 178 to make a connection. 

How to present a call from PSTN terminal to an H.323 terminal 

r011 81 When the callee is an H.323 terminal, again the call cannot go through directly. The Called Agent will construct 
a reply to inform the Calling Agent that the destination is actually an Internet address. The Calling Agent will route he 
call through either the PSTN or PSN depending upon billing and quality considerations. Once it is established that the 
calling terminal is a PSTN terminal and the called terminal is an H.323 terminal, there f'^^^^^^^^^^^ 

the PSTN telephony signalling components 172.174, the internet signalling components 181 ,183. the PSTN 170. bridge 
184 and PSN 178 to make a connection. ^ . ^ 

[01 19] in the two scenarios involving an H.323 terminal and a PSTN terminal, the quality option can be used to define 
the quality of service on an Internet phone call. Some of the options can be: 

1. codec - because an H.323 terminal can decode a small number of compressed voice data, the type of codec 
must be explicitly stated; . ■ . , w 

2. link-speed - some H.323 terminals are linked by modem. Therefore, the communication link cannot exceed 

certain bandwidth. 

3. video-data format - since H.323 can also support ITU standard T120 {video conference), it may be necessary 
to specify parameters such as compression method and the data rate. 

How to connect an H.323 terminal to an H.323 terminal 

[0120] When connecting two H.323 terminals, the reply mail will contain Internet addresses for the caller and the 
callee. The Internet signalling components 181.183 can use the information together with the quality and option infor- 
mation to establish the call, 

[01 21] It should be noted that after a TCP/IP connection is established by the H.323 terminal for communication, the 
•<gradc> component in the E-mail can bo used to specify the quality of service using the RSVP (resource resen/ation 
protocol) protocol. One of the problems with the RSVP protocol is that is it is receiver originated. Without the <grade> 
information, the callee v^here data is received can request the highest quality while the caller has to pay for the service. 
With the <grade> information, which can be a user feature to reduce the grade of service, the caller wilt not be over- 
charged. 
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CALL SETUP WALKTHROUGH 



[0122] A call setup walkthrough will now be described in detail with reference to Figure 3 

[0123] To begin, a user will originate a call from some calling terminal 200 (this being a particular one of the user's 
available terminals 102.104,106 shown in Figure 2) resulting in a call setup request being generated. The call setup 
request which contains the callee's user identifier ,s passed through the terminal network intertace (not shown) and 
the local network interface where it will be intercepted, converted to a generic form by the presentation driver (not 
shown), and passed to the Calling Agent. In POTS, the call is Intercepted by the captive office. In GSM/PCS the call 
mTJi'^'T > V r^^'!^''"'^ °' '^^ cellstation. In an Internet call, the call is intercepted by an Internet gatekeeper 

[0124] Next, the Calling Agent 114 examines the called user identifer contained in the setup request and looks up a 
corresponding destination E-mail address in the address database (not shown). The Calling Agent will then generate 
an outgoing E-mail message to the address as described above. The E-mail message is then delivered by the calling 
hinh^f '.'Tr^ '° "^^^ ^^^^^.^82 over the Internet. This E-mail should always be sent using the 

highest pnonty The mail servers 180,182 should observe this priority and deliver the message as quickly as possible 

2T^nZ°Z^ ""T^^l' ^^'^T^' "^^il s^^^r 182 need to be processed quickly almost in real time,' 

and to be passed quickly to the Called Agent 116. 

r.T. TK T^' '° ""^ ''^"^^ ""S^"' '^^ '^^"^'^ ^^9^"' 'contents of the 

E-mail message. The call originator's information will be extracted from the message. The Called Agent will identify 
the current terminal associated with the called party by looking up the relevant record in the user profile There may 

Tjn7T,\ ^'^^^ '^"^^ ^'^"'^ ''"''"9 ^^'^^ Parameters are negotiated and settled. The Called 
Agent will then present the call to the current terminal using the native call setup. If the user Is now associated with a 
cell phone, the call is delivered to the celco. If the user is now associated with the PSTN, the call is delivered to the 
rS, J a now associated with an H.323 terminal, the Called Agent will use H.323 to establish the call The 

Called Agent will determine whetherthe preferred medium identified in the message matches that of the current terminal 
Sh I ^ attempted. If no such conversion is possible, the call will be roieclod 

l "'^^ '^'"^""^ ^'^ ^ "^^^^^9^ ^"^^ ^id^°' '^x'. voice message and 

ZToTj'ZT , . ! "^'^ '° P^"^^"' '^^ attachments to .he destination termLl as 

?he c JlPH A ^h'^^' '^''^'^P'^' '"ay display graphics, video clips, audio clips, or alter.native ringing, 

calls and itnonlT"^ be con igured lo perform a personal agent function which for example may display incoming 
cans and respond to screened calls accordingly. / / y 



Supplementary Services 



Sc.url o, th?; r T ! ' '"'"""^ '-^P'^^^-^'^d or supported by this signalling system The 

nTlrTZZ nn^ '""^ '""^^'^^"'^"V -^^''^^ent from the existing implemented telephony 

network^Many of the services can be preserved. However, some of the call setup and billing support can be imple- 
mented differently The following sections outline how to implement these using the capability offered by this invention 



CLASS Service 



miSn.^ H^f ?°^'^°'' ^^^^ ^'^^ Signalling Service. It provides a number of services ranging from display 
MIME melnl '' H ^"9-9 'one. These capabilities are readily available using the attachment components in the 
bJ addTd previously The advantage of the signalling protocol is that video and graphics can also 



Caller ID 



to t^! n- mf Ti^ T """""^^ "^""^^'^ ' ^ ^ -character string corresponding 

whi^e paaTdaLbVsf 't"L ^'^''7 °' '''"^ '^^^'^'^'^^ ^'^-9 ^^''^^ the local 

Ts suchTai?erT^^^^^^^ "T"^ '"^'^^^ '"^ ^^^^^^'^^ ='^'"9 - the call setup signalling and 

rnHuH?,hf , .'""'^^^ '^^ "^-"^ 'o"9 distance calls. However, the invention provides the opportunity to 

include this information which makes the Caller ID name service extendable across long dLance areas 



Call Forward 



[0129] Call forward means the user of a particular directory number would like to receive future incoming calls at a 
different location. This can be easily done by changing the current terminal associated with the uslT 
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Simple Call Management 

roi 301 The Agent based architecture provides an additional business opportunity for the telephone networks which 
Lly not oi erSe easily extended to support multi-media. The following describes three typical call scenarios which 
provide new capability lor users. Collectively, all these scenarios can be treated the same way 

Destination Busy 

[01 31 ] When the destination ,s busy, the typical treatment is to let the caller decide to '^[^If^^^^^^^^^^^^ 

and implementation may be made available to charge the user on a per usage basis to ring back. This can be an option 

specified by the caller in the user profile. 

Call Not Answered 

[01 32] When the callee is not around the terminal, the call can be offered, but no body is going to answer it. 

Call Rejection 

[01 33] Because of the attachment, a callee will know who is calling. The call can be rejected from an H.323 terminal 
or an ADSI terminal with a visual call wailing feature. 

Treatment 

[01 34] When one of the above scenarios happens, the user can be presented with the following options: 

1 loave a voice message for the callee in which case the message will be digitized by the Calling Agent. The 
dioilized message will be sent and attached to a call setup reply message as an attachment. ^ „. ^ , 

2 a fax toThe caller which can be retrieved by the callee later. The fax will be stored by the Calling Agent 
and sent to the Called Agent which will attach the fax to a call setup reply message as an attachment 

Unified Messaging Support (UMS) 

[01 35] This invention allows the telephony sen/ices to evolve around a UMS. Users can use the UMS to get the caller 
id record, voice message, fax message or event text message. 

Gall Transfer 

[01 36] If the call transfer is within the same network, existing telephony protocols (except Internet terminal) have a 
well defined procedure to handle the transfer. These are replicated here. 

mi 37] This invention does not provide a new support to transfer calls between different networks or media^Howeve 
because the Calling Agent and Called Agent can be extended to monitor the life cycle of a call, ,t can provide support 
and coordinate the transfer calls between different networks and media using the following procedures. 

Transfer Between Different Network Types 

[01 38] 

1 . The use, will signal the Agent (Calling or Called Agent) to perform the call transfer either through in-band (flash 
and dial) or out-of-band signalling from another terminal, 

2. The Agent will request the local network interface to disconnect the voice channel connected to terminal. 

3 The Agent will command the interface to the telephony network. 

4 Another call is established to the new destination under the control of the Agent through a gateway 

• 5, After the now call to the new destination is established, the voice channel from the network is routed to the new 
destination. 
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Transfer Between Different Media Types 



[01 39] 



1 . The user will signal the Agent (Calling or Called Agent) to perfornn the call transfer either through in-band (flash 
and dial) or out-of-band signalling from another terminal. 

2. The Agent will request the local network interface lo disconnect the voice channel connected to terminal. 

3. The Agent will comnnand the interface to the telephony network to suspend the call. 

4. Another call is established to the new destination under the control of the Agent through a gateway. This gateway 
will be responsible for the conversion of the medium type. e.g. codec. 

5. After the new call to new destination is established, the voice channel from the network is routed to the new 
destination. 



Detailed Description of Call Transfer Interface 



From PSTN Network 



[0140] The first step in switching to another terminal is to suspend the current call and signal the switch for the 
transfer. The following scenarios describe the common procedure used to suspend the current call and signal the 
switch for the transferring. 

1. From an analog terminal, user will flash and perform a call forward operation. 

2. From a digital set. e.g. ISDN, the terminal will send a supplemental service message to request the terminal to 
be forwarded. 



[0141] Once the call is suspended, the user can signal a request to be connected to the Call Agent which can handle 
the call transfer. One way to request to be connected to the Call Agent is to use the "*nn" convention. For example, 
the code can be assigned for this function. 

[0142] After the call is suspended, the user can press '-11" and log on to the Calling Agent with appropriate identi- 
fication and authentication. From the data where the input is coming from, the Calling Agent can identify the suspended 
call. Then the user can instruct how the call will be forwarded. There are two treatments to his request. 

1 . The feature can limit the transfer among the terminals subscribed by the user. It does not allow the user forward 
to any other terminal. However, if the user wants lo forward to any other terminal, there may be an existing call 
forward supplementary feature to support it. 

2. The call forward can be to the terminals for which the user subscribed to the service and any other terminals. 
In this case, the interaction can be designed to prompt the user to determine which kind of transfer will be required. 
For the subscribed terminal, the user can select from a list presented by the Calling Agent. For any other terminal, 
the user enters the destination directory number. The Calling Agent will use the existing supplementary services 
to perform the call transfer. There are two treatments to support this service. In the first, the customer must sub- 
scnbe to the supplementary service before it can use this feature, and in the second, the telco/ceico can charge 
the user on per usage basis. 

[0143] If the destination is a PSTN directory number (DN). the switch can use existing software to perform the call 
forwarding. 

[0144] If the destination is an H.323 terminal, the call is routed through Voice Over fP Gateway. 
From H.323 Terminal 



[01 45] If the destination is another H.323 terminal, it can use the supplementary sen/ices to be defined for the H 323 
to perform the call transfer. 

[0146] If the destination is a PSTN terminal, the call can be routed to an Internet Terminal Gateway. 
Alternate Access to the Calling Agent 

[01 47] When a customer is away from the set of registered terminals, he can access the Calling Agent using different 
vehicles. This section describes several possible implementations. 

[01 48] All these procedures incur the authentication of the user. The charge can be made to the user's account rather 
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that the owner of the terminal. 



Access from POTS or Equivalent 
5 [0149] The following procedure can be used from a terminal which has a telephony key pad and no other display 
device such as a POTS terminal. 

1 Dialinq a special designated terminal number which will connect the voice channel to a IVR (interactive voice 
responS s J^^^^^ a front end of the Calling Agent. This IVR system w.ii collect the .nformat.on and forward 

w the information to the Calling Agent. 

2 Log on using the user's account name and password. 

3. The IVR system prompts the user for the destination terminal number. 

4 If there is no called address handler go to step 7. ^ - u • 

5. If called address has a handler, the handler will be activated and connects to the voice channel. 
15 6 When the called address's handler has finished, go to step 7. 

7. Calling Agent constructs the MIME message and uses MCSS to establish the call. 

Access from ADSI Terminal or Equivalent 

20 [0150] The lollowing procedure can be used to establish a call from an ADSI (analog display services interface) 
terminal which has a display and programmable buttons. 

1 Dial a special number on an ADSI server which has support for MCSS. 

2 The user performs the log on using the user's account name and password. 

25 3 The ADSI server will download an ADSI scnpt to prompt the user with additional destination information such as. 



callee address 

medium (e.g. voice or fax) 

quality (using PSTN long distance or through Internet Gateway) 

4 ,f there is a callee address handler, an ADSI script can be downloaded to the terminal to acquire more information. 
5* When the data input is completed, the Calling Agent receives all the information and proceeds with the call setup. 

Access from an H,323 Terminal with Web Browser Support 

[0151] The following procedure can be used to establish a call from an H,323 Terminal with Web Browser support. 

1 Access a Universal Resource Locator of the Calling Agent 

2 Perform log on using the user name and password with encryption enabled and a public key used. 
40 3 The Calling Agent's Web interface will download a form to acquire the callee address information. 

4 If there is a callee address handler, the callee address handler will send another form to collect more data. 
5. After all information is collected, the Called Agent performs an Internet terminal call setup on behalf of the caller 
The call will be a callback type which means the destination call originate the H.323 call. 



45 Create Attachment for the Call 

[0152] The call setup E-mail has the capability to include fax. video clip and voice clip. The following descripti. 
outlines how these conlenls can be created and included in the MIME message. 



50 Attach Voice Clip to a PSTN Call 

[0153] The following procedure can be used to create a call with a voice clip included. 

1 . User calls a special number to connect to the Calling Agent. 
55 2, The user will use the password to authenticate his/her identity. 

3. The user records a voice clip. 

4 The user instructs the Calling Agent to call a destination 
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Attach Fax to a PSTN Call 

[0154] The following procedure can be used to attach a faxed document to a PSTN call. 

1 . User calls a special number to connect to the Calling Agent. 

2. The user informs the Calling Agent to prepare a call with a Fax attachment. 

3. The Calling Agent gives a terminal number and password to the user. 

4. The terminal number is a fax reception server The password allows an association of the fax uploaded and the 
current call request. 

5. The user dials the terminal number to prepare the fax. 

6. The fax server will ask the user to enter the password. 

7. If accepted, the fax protocol for transmission is carried out. 

8. Once the fax transmission is complete, the Calling Agent can construct the MIIVIE message to establish the call 
or just deliver the Fax. 

[0155] In an alternative to this procedure a user can access the fax server, with proper authentication using password 
and fax the document. The fax server will provide a fax identification which can be used to instruct the Calling Agent 
to extract the fax from the fax server to construct the MIME message. With this technique only one terminal call Is 
active at a given time so the user can have a single line for lax and voice call. 

[0156] Similar funclions can be executed on a PC which connects to the Calling Agenl via a dial up line or Elhemet 
In this case, the file can be sent to an FTP (file transfer protocol) server rather than a Fax server 

Access to MIME Messages Through UMS 

[0157] The call setup messages arc delivered as MIME message. They can be stored on a Unified Messaging Sys- 
tems' (USM) message server such as Microsoft's Exchange, Sun's Solstice or Lucent's Intuity The interface to these 
message will provide access to various components constituting the call setup message. 

Caller Infomnation 

[0158] The caller's call setup requests are stored as E-mails or messages on the Unified Messaging System These 
E-mail are the equivalent of the caller identification records on a Caller ID device. 

Attachment 

[01 59] The UMS interface can retrieve and present the attachment (such as the text message, voice message fax 
or even video) to the user ^ 

Signal Flow Examples 

[0160] Various signal flow examples will now be described with reference to Figures 6-1 2. In these figures the num- 
bered arrows represent message flows. 

[0161] Figure 6 shows the message flow for a basic voice call. In step 1 , the Calling Agent constructs the call setup 
reques message and sends it to the mail server to be sent to the Called Agent. In step 2, the mail sen/er sends the 
E-mail to the PSN network. In step 3, the E-mail arrives at the Called Agent's mail server In step 4, the Mail Server 
notifies the ma client which is the Called Agent of the arrival of the E-mail. In step 5, the Called Agent issues a command 
(using the mail protocol) to retrieve the E-mail. In step 6, the E-mail is delivered to the Called Agent. In step 7 the 
Called Agent constructs a reply and sends this to the mail server. In step 8, the mail server sends the E-mail to the 
th! rJlr T I ! ^'"^^^ ^' ""^ ^""'"9 ^Sent's mail seiver In step 10. the mail server sends a notification to 

the Calling Agent. In step 11 . the Calling Agent requests the mail server todeliver the E-mail. In step 12, the mail server 

ihelan ^^'""^ ^""^ '"^ ^^"'"^ ^^^"^ ""^ information in the reply message to establish 

[01 62] Figure 7 shows the message flow for a voice call with no answer In step 1 , the Calling Agent constructs the 
call se up request message and sends it to the mail server to bo sent to the Called Agent. In stop 2, the mail sen/or 
sends the E-mail to the PSN network. In step 3. the E-mail arrives at the Called Agent's mail server In step 4 the Mail 

ZlZTl^V u"^"' ^^"^^ ^9^"' °' "^^ °' '^^ E--^^'' ^'^P Called Agent presents 

the call to the terminal through the presentation driver In step 6, the user creates an attachment The attachment can 
be voice message, fax, or graphics. The Calling Agent creates a reply message and passes it to the mail server In 
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step 7 the mail server sends the E-mail. Ir. slep 8, the mail is delivered to the Called Agent mail 'j^f P 

S selr sends . message arrival notification to the Called Agent will store the reply message with attachment to 

mVe^'Ftgure Tshrs'ca'torwarding to another MCSS user. In step 1 , the Calling Agent constructs the caH setup 
equest message and sends it to the mail server to be sent to the Called Agent. In step 2, the mail sen/er sends the 
E mairio theTsN network In step 3, the E-mail arrives at the Called Agent's mail server. In step 4, the mail server 
noUfti the maif cln r^ch ,s the Called Agent 1 of the arrival of the E-mail. In step 5. the Called Agent 1 requests 
he ser^to"^^ E-mail. In step 6, by examining the user profile, the Called Agent 1 finds out that he call 

0 b o Sed t'o another user handled by Called Agent 2. In step 7 the Called Agenn instructs the ma^ se^vj 
10 forward the E-mail to the Called Agent 2. In slep 8, the mail server delivers a message arrival notification to Called 
Age 72 'n step 9 thl Called Agent'2 requests the mail server to deliver the mail. In step 1 0 the ca se up request 
messaae is sent to the Called Agent 2. The Called Agent 2 can either initiate negotiation or accept the call. 
^0^64? F gure 9 Shows the Joe message service/personal agent sen/ice. In step 1 , the Calling Agent constructs 
hl ca 1 setup eques^message and sends it to the mail server to be sent to the Called Agent. In step 2. the r^ail serve 
endt he E-maN o he PSN network. In step 3, the E-mail arrives at the Called Agenfs mail server. In step 4, the ma 

server notmes the mail client which is the Called Agent ol the arrival ol the E-mail. In step 5, after -^n^^'^'^S^^^^^J^ 
prome the Called Agent constructs a reply message which will connect the call to a voice message service server or 
a Dersonal aqent service server. The redirection in done by specifying the called address of where the call can be 
competed by me clng Party. The reply message is passed to the mail se^er. In step 6. the mail server sends this 
oThe nefwork s?ep 7. the reply maiNs delivered to the mail server In step 8, the mail server sends a message 
arrival noSication to the Galling Agent. In step 9. the Calling Agent requests the mail sen,er .0 deliver the message^ 
r 0 he ,.ai, server delivers'the reply message to the Calling Agent. The Called Agent 

of the reply and determines the call is accepted, and instructs the signalling components to complete the call WHhout 
answering. The call is actually delivered to a voice message service or personal agent service. ,^ 
mi651 figure 10 shows the "follow mo" scenario. The user is now at a terminal which ,s not controlled by the Called 
Agen for the usir He/She first connects to the Call Agent of the user. He/She instructs the Call Agent to change he 
Z profile to deliver calls to a specific terminal by giving its address. The Call Agent for the user - -^^J^-^^^^^^^ 
and updates the user profile to be used by the Called Agent. In step 1. the Calling Agent constructs the call setup 
requ t m sage and sends ,t to the mail server to be sent to the Called Agent. In step 2, the ----3^^^^^^^ 
E-mail to the PSN network. In step 3, the E-mail arrives at the Called Agenfs mail server In step 4. the Mail Server 
notifies the mail client which ,s the Called Agent of the arrival of the E-mail In step 5, the '^^^^ '^^^^^^^^^^^^^ 
mail server to deliver the E-mail. In step 6, by examining the user profile, the Called Agent f nds our ha the call is 
forwarded to Terminal A. In step 7, the Called Agent constructs a reply message which accepts the call ^«'th Tejhma 
A's address as the Callee Address. The message is passed to the mail server In step 8, the mail server send the r^aH 
to the PSN in step 9, the PSN delivers the mail sen/er In step 10 the mail server sends a message arrival notification 
to the Calling Agent. In step 1 1 , the Calling Agent requests the mail server to deliver the message^ In step 1 2, the ma. 
server delivers the E-mail to the Calling Agent. The Calling Agent extracts the message and finds out it ,s an accept 
reply message. It instructs the telephony signalling components to complete the call using the address in the reply 

mi 661^%igure 1 1 , shows a multi-media message with attachment. The user connects to the Call Agent to provide the 
contents of a multi-media message. The user can record a voice message. He/She can fax the document to the Call 
Aqent He/She can upload an electronic file using File Transfer Protocol to the Call Agent. The Gall Agent provides an 
identity to every artifact stored The user connects to Calling Agent and instruct the Calling Agent to establish an 
outgoing call using the artifacts stored at the Call Agent. The Calling Agent asks the Call Agent to provide the artifacts 
using the id provided by the user The Call Agent sends the electronic copy of the artifact to the Calling Agent. In step 

1 the Calling Agent constructs the call setup request message with all the artifacts as attachments and sends it to the 
mail server to be sent to the Called Agent. In step 2, the mail server sends the E-mail to the PSN network, In step 3 
the E-mail arrives at the Called Agent's mail server In slep 4, the Mail Server notifies the mail client which is the Called 
Agent of the arrival ol the E-mail, In step 5. the Called Agent issues a command (using the mail protocol) to retrieve 
the E-mail In step 6. the E-mail is delivered to the Called Agent. In step 7, the Called Agent extracts the attachments 
and presents them to the terminal selectively according to the terminal capability described in the terminal profile. Later 
il constructs a reply and sends this to the mail server In step 8, the mail server sends the E-mail to the PSN. In step 
•9 the E-mail arrives at the Calling Agent's mail server In step 10, the mail server sends a notification to the Calling 
Agent. In step 11 . the Calling Agent requests the mail server todeliver the E-mail. In step 12, the mail server delivers 
the E-mail to the Calling Agent. The Calling Agent extracts the contents in the reply message to terminate the call with 
information in the reply or initiate negotiation or initiate a call setup using the signalling components. 

[0167] Figure 12 shows a multiple multi-media call setup. The user connects to the Calling Agent and requests a 
muliiple-call setup request The Calling Ageni redirects the user's call to an IVR system to collect the multiple call setup 
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InTJ^'^^TTt « connplete. .he I VR system passes the multiple call setup request the Calling Agent 

In step 1. the Calling Agent constructs the call setup request message with multiple call requests In step 2 the mail 

tuZJ,T" ^;rV.° '"^^^'^ "'"P ^^"^^^ ^' "^^ Agent's mail server. In step 4 

the Man Server notifies the mail client which is the Called Agent of the arrival of the E-mail. In step 5, the Called Aqent 

l'n!n VrT? i". "^ ""^ '° ^'^P 6' i= "^slivered to the Called Aqent 

n ! !n I' r '^^ '^^'^^ae and constructs a reply to accept all thp calls 

n steo ^o tTlTZ"' ^'T '° ''^P ''^ ^""^^ ^' '^^ C^"*"9 Agent's mail server, 

in step 10, the mail server sends a notification to the Calling Agent. In step 11 , the Calling Agent requests the mail 
server to deliver the E-mail. In step 12 the mail server delivers the E-mail to"he Calling Agent ?he cXg Agen, 7^1 
up calls using the address information in the message. ^ ^ 

[0168] An attachment may be presented to the terminal without completing the call if the called party chooses this 

fnllhl ,^''7'°"^ modifications and variations of the present invention are possible in light of the above teachings 

\Zl^L!.T^ '""'''^i^'' embodiments, the Called Agent and the Calling Agent are network components Alternatively 
ponents '° " network-wide distributed implementation of these com 

feVuos J.l^r.T'^' T ^ '^"^'^ "^'"'^^ P^rfor-^'-ng call signalling for multimedia call 

se ups. A user equipped with calling terminals of various types may initiate a call from any of ihese terminals and the 

stnZT.T' -^^^^-'^'-^ 'he system. A calling agent looks up an E-mail address for the called party and 

ThTn a conlloTf w f '""""^ ""'^'""^ ^genta call medium and other parameters are established. 
Then a connection is made between a calling terminal and the current terminal. This provides a generic siqnallina 
systern for a calloe using a wireline terminal, wireless terminal, or H.323 terminal to be connected to a called terminal 
also being any one of these or other types. ^ant,u lui rmndi 



Claims 



^' tT^^ilTi ^"1 ^^"^"^ comprising a calling agent for connection to a network for coordinating 

Sling agentZ^^^^^ ' ""'"'^^ ^^^^ 

a) means for receiving a call setup request including a user identifier 

b) means for looking up an electronic network address corresponding w/ith the user identifier 

""^TV^' generating a call setup electronic message with said electronic network address and sending it 

to saia aaaress; and ^ 

fil'T T^T '^^^^^'"^^'"S establishment of an outgoing connection between a calling terminal and 
me anoiner terminal. 

^' the canlJi'gTermtar "^'"^ ' ' "^''^ ^ ^"^^'""^ ''^^ ^^^^^^l '^^"^ 



3. 
4. 



A system as claimed in claim 1 or claim 2, further comprising a user interface for receiving the call setup request. 

or^mZZ^^'T 1°"" °' 1 to 3, further comprising a terminal profile database containing a terminal 

whe einTe c ,1 ' " '^^'^"^ "^'^^'"9 ^ '^P^ -«ch terminal, 

wherein the calling teiminahs one of the terminals. 

5. A system as claimed in any preceding claim, wherein a canned terminal profile is used when the calling terminal 
IS not included in said terminal profile database. ^ lerminai 

of whicrorsald u.t'r."' ""T'"' "^^^^^^^ ^ ^^^^ P^°"'^ •^^'^•^^^'^ "=°"'^--9 - identification 

oi wnich of said user's terminals a user is currently using. 



7. 
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A .vstem as claimed in any preceding claim, wherein said outgoing connection is established over a packet 
sJched netwTo a public swi.ched'alephone network depending upon billing and quality cons.derat.ons, .n 
cooperation with signalling components with the selected network. 

A svstem as claimed in any preceding claim. lurlher comprising local network Interfaces between the calling agent 
and each of the user's calling terminl lor supporting calling terminals of various types including cellular term.nals. 
wireline terminals, and H.323 terminals. 

A c^vstem as claimed in any preceding claim, further comprising a calling presentation layer between the calling 
" aqen and the c"Ig erminal for performing a receive type conversion on signals received through the outgoing 
SnnlcTon from said another term^al from the transmission format used over the outgoing connection to a caHing 
Tmina normauequired by the calling terminal if the calling terminal format is different from the ^'^-^"J^^^^'^ 
anT or oedolinq a transmit type conversion on signals to be sent through the outgoing connection from the 
ca?inr.ermina7ron4; to transmission format if .he calling terminal format is different from the transm.ssion 
format. 

I. A system as claimed in any preceding claim, further comprising a called agent for handling incoming call setup 
electronic messages, the called agent comprising: 

a) means for receiving an incoming call setup electronic messages, the incoming call setup electronic message 
:;:::^:ZS:^T^cunen. termmal Identifier which identifies a current terminal associated with the user 

STeciJnd means for coordinating the establishment of an incoming connection between the current terminal 
and another terminal which originated the call setup. 

2 A system as claimed in any preceding claim, wherein the network comprises a packet switching network (PSN) 
and ; pTbHc sUched telephone network (PSTN), and wherein said first means for coordinat.ng the estabhshnnent 
of an outgoing connection participates in the selection of either the PSN or the PSTN for the outgoing connec .on, 
and hen cooperates with a native'signalling component for the selected network to make outgoing conne t.oa 
and wherein said second means for coordinating the establishment of an incoming connection participates ,n the 
sefecton r^her the PSN or the PSTN for the incoming connection and then cooperates with a native signalling 
component for the selected network to make the incoming connection. 

13 A system as claimed in any preceding claim, wherein said first and second means for coordinating the establish- 
mem of an outgoing and incoming connection respectively participate in a determination of a transmission format 
p?ich said connection, the system further comprising: 

a caLd presentation layer between the called agent and the current terminal for perlorming a receive type 
conversion on signals received through the incoming connection from a transmission format used over the incoming 
connection to a current terminal format required by the current terminal if the current terminal forma tis different 
from the transmission format, and for performing a transmit type conversion on signals to be sent thr°"9h 
incoming connection from the current terminal formal to the transmission format if the current terminal format is 
different from the transmission format.. 

14. A system as claimed in any preceding claim, further comprising an interface to a Unified Messaging System or 

personal agent sen/ice. 
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